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Abstract.  A  general  method  is  given  to  solve  tight  frame  optimization 
problems,  borrowing  notions  from  classical  mechanics.  In  this  paper, 
we  focus  on  a  quantum  detection  problem,  where  the  goal  is  to  con¬ 
struct  a  tight  frame  that  minimize  an  error  term,  which  in  quantum 
physics  has  the  interpretation  of  the  probability  of  a  detection  error. 
The  method  converts  the  frame  problem  into  a  set  of  ordinary  differ¬ 
ential  equations  using  concepts  from  classical  mechanics  and  orthogo¬ 
nal  group  techniques.  The  minimum  energy  solutions  of  the  differential 
equations  are  proven  to  correspond  to  the  tight  frames  that  minimize  the 
error  term.  Because  of  this  perspective,  several  numerical  methods  be¬ 
come  available  to  compute  the  tight  frames.  Beyond  the  applications  of 
quantum  detection  in  quantum  mechanics,  solutions  to  this  frame  opti¬ 
mization  problem  can  be  viewed  as  a  generalization  of  classical  matched 
filtering  solutions.  As  such,  the  methods  we  develop  are  a  generalization 
of  fundamental  detection  techniques  in  radar. 


1.  Introduction 

We  present  a  general  framework  for  approximating  solutions  to  tight 
frame  optimization  problems.  As  an  application  of  our  method,  we  focus  on 
a  quantum  detection  problem  and  give  an  easily  implementable  numerical 
algorithm  for  the  solution  in  Section  4.4.  While  there  exists  other  algorithms 
specifically  designed  for  the  construction  of  tight  frames  that  solve  the  quan¬ 
tum  detection  problem,  [23,  22,  28],  our  method  generalizes  to  other  tight 
frame  problems,  and  we  choose  the  quantum  detection  problem  due  to  its 
inherent  relevance  to  other  applications  and  interest  of  the  authors.  See 
[43]  for  general  code  implementation,  and  for  applications  in  other  frame 
theoretic  problems. 

We  shall  define  a  frame  optimization  problem  which  resembles  classical 
mean  square  error  (MSE)  optimization,  but  is  generally  only  equivalent  to 
MSE  in  geometrically  structured  problems.  See  the  Appendix  (Section  A. 5) 
for  the  properties  of  geometrically  uniform  solutions  of  the  frame  MSE  prob¬ 
lem.  In  fact,  our  technical  goal  is  to  construct  a  so-called  tight  frame  that 
minimizes  an  error  term,  which  in  quantum  physics  has  the  interpretation  of 
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the  probability  of  a  detection  error.  As  such,  we  shall  also  refer  to  our  frame 
optimization  problem  as  a  quantum  detection  problem.  Our  setting  is  tight 
frames  because  of  the  emerging  applicability  of  such  objects  in  dealing  with 
the  robust  transmission  of  data  over  erasure  channels  such  as  the  internet 
[14,  32,  42],  multiple  antenna  code  design  for  wireless  communications  [41], 
A/D  conversion  in  a  host  of  applications  [8,  7,  34],  quantum  measurement 
and  encryption  schemes  [50,  51,  10,  27,  26],  and  multiple  description  coding 
[33,  55],  among  others.  The  complexity  of  some  of  these  applications  goes 
beyond  MSE,  cf.,  matched  filtering  in  the  quantum  detection  setting  [6], 
matched  filtering  in  applied  general  relativity  [1,  2,  60],  and  minimization 
for  multiscale  image  decompositions  [56],  see  also  [30]  for  orthogonal  MSE 
matched  filter  detection.  Furthermore,  quantum  detection  has  applications 
in  optical  communications,  including  the  detection  of  coherent  light  signals 
such  as  radio,  radar,  and  laser  signals  [40,  45,  46,  44],  and  applications  in 
astronomy  as  a  means  of  detecting  light  from  distant  sources  [40,  57]. 

The  frame  optimization  problem  is  defined  in  Section  1.2  along  with  the 
definition  of  frames.  Section  1.1  includes  background  material  for  the  prob¬ 
lem  from  the  quantum  mechanics  point  of  view.  Section  1.3  is  devoted  to  an 
outline  of  our  solution,  as  well  as  an  outline  of  the  structure  of  the  paper. 

1.1.  Background.  In  quantum  mechanics,  the  definition  of  a  von  Neumann 
measurement  [35,  53,  59]  can  be  generalized  using  positive-operator- valued 
measures  (POMs)  and  tight  frames  [40,  24,  27].  See  the  Appendix  (Section 
A.l)  for  the  definition  of  a  quantum  measurement  in  terms  of  POMs,  and 
Section  1.2  for  the  the  definition  in  terms  of  tight  frames.  This  generalized 
definition  of  a  quantum  measurement  allows  one  to  distinguish  more  accu¬ 
rately  among  elements  of  a  set  of  nonorthogonal  quantum  states.  We  can 
formulate  our  frame  optimization  problem  of  Section  1.2  in  terms  of  quan¬ 
tum  measurement.  In  this  case  the  frame  optimization  problem  becomes 
a  quantum  detection  problem  for  a  physical  system  whose  state  is  limited 
to  be  in  only  one  of  a  countable  number  of  possibilities.  See  the  Appendix 
(Section  A. 2)  for  details.  These  possible  states  are  not  necessarily  orthogo¬ 
nal.  We  want  to  find  the  best  method  of  measuring  the  system  in  order  to 
distinguish  which  state  the  system  is  in.  Mathematically,  we  want  to  find 
a  tight  frame  that  minimizes  an  error  term  Pe.  In  the  context  of  quantum 
detection  in  quantum  mechanics,  Pe  is  in  fact  the  probability  of  a  detection 
error.  See  the  Appendix  (Sections  A.l  -  A. 4)  for  details. 

The  quantum  detection  problem  we  consider  has  not  been  solved  analyt¬ 
ically  in  quantum  mechanics.  Kennedy,  Yuen,  and  Lax  [62]  gave  necessary 
and  sufficient  conditions  on  a  POM  so  that  it  minimizes  Pe.  In  fact,  they 
show  that  Pe  is  minimized  if  and  only  if  the  corresponding  POM  satisfies  a 
particular  operator  inequality.  Hausladen  and  Wootters  [39]  gave  a  construc¬ 
tion  of  a  tight  frame  that  seems  to  have  a  small  probability  of  a  detection 
error,  but  he  did  not  completely  justify  his  construction.  Helstrom  [40] 
solved  the  problem  completely  for  the  case  in  which  the  quantum  system  is 
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limited  to  be  in  one  of  two  possible  states.  Peres  and  Terno  [50]  solved  a 
slightly  different  problem  where  they  optimized  two  quantities.  They  con¬ 
structed  a  POM  that  maximized  an  expression  representing  the  information 
gain  and  minimized  another  expression  representing  the  probability  of  an 
inconclusive  measurement.  Eldar  and  Bolcskei  [25]  gave  an  analytic  expres¬ 
sion  for  the  tight  frame  that  minimizes  Pe  in  the  special  case  where  the 
quantum  states  form  a  geometrically  uniform  set. 

1.2.  Definitions  and  problem.  A  frame  can  be  considered  as  a  general¬ 
ization  of  an  orthonormal  basis  [17,  20,  61,  18,  9].  Let  H  be  a  separable 
Hilbert  space,  let  K  C  Z,  and  let  {ej}jex  be  an  orthonormal  basis  for  H. 
An  orthonormal  basis  has  the  property  that 

Vx  £  H,  ||x||2  =  \{x,ej)\2. 

ieK 

We  use  this  property  to  motivate  the  definition  of  a  frame. 

Definition  1.1.  Let  H  be  a  separable  Hilbert  space  and  let  K  C  Z.  A  set 
{ei}ieK  C  H  is  a  frame  for  H  with  frame  bounds  A  and  B,  with  0  <  A  <  B, 
if 

Vx  G  H,  A||x||2  <  ^  |(x,  ej)|2  <  L>||x||2. 

i&K 

A  frame  {ei}i^K  for  H  is  a  tight  frame  if  A  =  B.  A  tight  frame  with  frame 
bound  A  is  an  A-tight  frame. 

Problem  1.2.  Let  H  be  a  d- dimensional  Hilbert  space.  Given  a  sequence 
C  H  of  unit  norrned  vectors  and  a  sequence  {pi\P=1  C  M  of  positive 
weights  that  sums  to  1.  The  frame  optimization  problem  is  to  construct  a 
1-tight  frame  {e*}^1  that  minimizes  the  quantity 

N 

Pe{{ei}fLi)  =  1  ~^2pi\(xhei)\2,  (1.1) 

i=l 

taken  over  all  IV-element  1-tight  frames.  Such  a  tight  frame  exists  by  a 
compactness  argument.  See  Theorem  A. 7  in  the  Appendix  (Appendix  A. 4) 
for  a  proof.  Our  goal  is  to  quantify  this  existence. 

We  have  taken  YliLi  Pi  =  1  because  of  the  probabilistic  interpretation  in 
the  Appendix.  This  condition  is  not  required  in  the  main  body  of  the  paper, 
even  though  we  use  it  as  a  technical  convenience  in  Section  3. 

1.3.  Outline.  The  frame  optimization  problem  (1.1)  has  many  applications 
as  implied  in  the  first  paragraph  of  the  Introduction.  To  illustrate  the  con¬ 
nection  between  the  frame  optimization  problem  and  quantum  mechanics, 
beyond  Section  1.1,  and  as  a  background  for  some  of  our  technology,  we 
have  included  an  Appendix,  as  mentioned  in  Section  1.1.  In  Section  A.l  we 
present  quantum  measurement  theory  in  terms  of  POMs;  and  then  motivate 
a  quantum  detection  problem  in  Sections  A. 2  -  A. 4.  In  particular,  Section 
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Frame  optimzation  _  Section  _  Quantum  mechanical 

problem  ^-4  quantum  detection  problem 


Figure  1.  Outline  of  the  solution. 


A. 4  expounds  the  remarkable  and  elementary  relationship  between  POMs 
and  tight  frames.  Using  this  relationship,  we  formulate  this  quantum  de¬ 
tection  problem  as  the  frame  optimization  problem  of  Section  1.2.  Figure 
1  describes  our  solution  to  these  equivalent  problems;  and,  in  particular,  it 
highlights  some  of  the  various  techniques  that  we  require. 

We  begin  in  Section  2  with  preliminaries  from  classical  Newtonian  me¬ 
chanics  [47]  and  the  recent  characterization  of  finite  unit  norrned  tight  frames 
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as  minimizers  of  a  frame  potential  [5]  associated  with  the  notion  of  frame 
force. 

In  Section  3  we  use  Naimark’s  theorem  to  simplify  the  frame  optimization 
problem  by  showing  that  we  only  need  to  consider  orthonormal  sets  in  place 
of  1-tight  frames.  We  then  use  the  concept  of  the  frame  force  [5]  to  construct 
a  corresponding  force  for  the  frame  optimization  problem.  In  Section  4  we 
use  the  orthogonal  group  O(N)  as  a  means  to  parameterize  orthonormal  sets. 
With  this  parameterization,  we  construct  a  set  of  differential  equations  on 
0(N )  and  show  that  the  minimum  energy  solutions  correspond  exactly  to 
the  1-tight  frames  that  minimize  the  error  term  Pe.  With  this  perspective, 
we  comment  on  how  different  numerical  methods  can  be  used  to  approximate 
the  1-tight  frames  that  solve  the  frame  optimization  problem. 

Finally,  in  Section  5,  we  give  an  example  of  computing  a  solution  to  the 
frame  optimization  problem  for  the  case  N  =  2.  The  purpose  of  Section  5 
is  to  serve  as  an  introduction  to  the  ongoing  numerical  work  found  in  [43]. 

2.  Preliminaries 

2.1.  Newtonian  mechanics  of  1  particle.  Suppose  x  :  M  — >  is  twice 

differentiable.  For  i  6  1,  we  denote  the  derivative  of  x  at  t  as  x(t)  and  the 
second  derivative  as  x(t).  x(t)  is  interpreted  as  the  position  of  a  particle  in 
R.d  at  time  t  €  M.  A  force  acting  on  x  is  a  vector  field  F  :  — *  Md,  and  it 

determines  the  dynamics  of  x  by  Newton’s  equation 

x(t)  =  F(x(t)).  (2.1) 

The  force  F  is  a  conservative  force  if  there  exists  a  differentiable  function 
V  :  — ►  M  such  that 

F  =  -VP, 

where  V  is  the  d-dimensional  gradient.  V  is  called  the  potential  of  the  force 
F.  The  following  elementary  theorem  [47]  shows  that  energy  is  conserved 
under  a  conservative  force. 

Theorem  2.1.  If  x  :  M  — ►  M.d  is  a  solution  of  Newton’s  equation  (2.1)  and 
the  force  is  conservative,  then  the  total  energy,  defined  by 

E(t)  =  x{t )]2  +  V(x(t)),  t.  €  M, 

is  constant  with  respect  to  the  variable  t. 

2.2.  Central  force.  Suppose  we  have  an  ensemble  of  particles  in  that 

interact  with  one  another  by  a  conservative  force  F  :  x  M.d  — »  Md.  Given 

two  particles  a,  b  6  Rd,  a  “feels”  the  force  from  b  given  by  F(a,b),  i.e.,  as 
functions  of  time  a(t)  =  F (a(t) ,  b(t)) .  This  action  defines  the  dynamics  on 
the  entire  ensemble.  If  the  force  is  conservative,  then  there  exists  a  potential 
function  V  :  x  — ►  M  such  that 


F(a,b)  =  — Va_feP(a,  b), 
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where  Va_6  is  the  gradient  taken  by  keeping  b  fixed  and  differentiating  with 
respect  to  a.  The  force  F  is  a  central  force  if  its  magnitude  depends  only  on 
the  distance  ||o  —  6||,  that  is,  if  there  exists  a  function  /  :  — »  M  such  that 

Va,6eMd,  F(a,  b)  =  f  {\\a  —  b\\)[a  —  b\. 

(M+  =  (0,  oo).)  In  this  case,  the  same  can  be  said  of  the  potential,  that  is, 
if  the  force  is  conservative  and  central,  then  there  is  a  function  v  :  M+  — >  M 
such  that 

Va,  b  G  Rd,  V(a,b)  =  v(||o-6||).  (2.2) 

Computing  the  potential  corresponding  to  a  conservative  central  force  is 
not  difficult.  In  fact,  for  any  a,  b  £  Md,  the  condition, 


F(a,b)  =  -V(a_fe)C(a,6), 

implies  that 

Vr  €E  M+,  v'(r)  =  —  r/(r),  (2.3) 

which,  in  turn,  allows  us  to  compute  V  because  of  (2.2).  To  verify  (2.3), 
first  note  that 

XI 


V.x  =  (x’i,  •  •  • ,  Xd)  £  Mrf,  V||x||  = 


X 

HI 


L  ^ xl+...+x2d  J 


Thus,  writing  x  =  a  —  b  £  Wi,  we  compute 

-Vk(a,  b)  =  — Vu(|H|)  |H|  =  -u'dHIDVHxll  =  -u'(||x| 

and,  setting  the  right  side  equal  to  F(a,b)  =  /(||a;||)a;,  we  obtain 


which  is  (2.3). 


x 


V  X  =  -  X  I  T  (  X 


2.3.  Frame  force.  Two  electrons  with  charge  e  and  positions  given  by 
x,  y  G  M3  “feel”  a  repulsive  force  given  by  Coulomb’s  law.  Particle  x  “feels” 
the  force  F(x,y),  exerted  on  it  by  particle  y,  given  by  the  formula, 

e2 

F(x,y)  =  Rt - tit  (x-y), 

\\x  -  y\\6 

where  K  is  Coulomb’s  constant.  Suppose  we  have  a  metallic  sphere  where  a 
number  of  electrons  move  freely  and  interact  with  each  other  by  the  Coulomb 
force.  An  unresolved  problem  in  physics  is  to  determine  the  equilibrium 
positions  of  the  electrons,  that  is,  to  specify  an  arrangement  of  the  electrons 
where  all  of  the  interaction  Coulomb  forces  cancel  so  that  there  is  no  motion 
[4,  3].  This  phenomena  corresponds  to  the  minimization  of  the  Coulomb 
potential. 

In  [5] ,  Fickus  and  one  of  the  authors  used  this  idea  to  characterize  all  finite 
unit  norrned  tight  frames,  see  Theorems  2.2  and  2.3.  The  goal  was  to  find 
a  force,  which  they  called  frame  force,  such  that  the  equilibrium  positions 
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on  the  sphere  would  correspond  to  finite  unit  norrned  tight  frames.  Given 
two  points  £  Rrf.  By  definition,  the  particle  x  “feels”  the  frame  force 
FF(x,y),  exerted  on  it  by  particle  y,  given  by  the  formula, 

FF(x,  y)  =  (x,  y)  ( x-y ) .  (2.4) 

It  can  be  shown  that  FF(x,y)  is  a  central  force  with  the  frame  potential 
FP  given  by 

FP(x,y)  =  ]^\{x,y)\2. 

Let  {xi}fL1  C  be  a  unit  norrned  set,  i.e. ,  {xi}f=1  C  Sd~l,  the  unit  sphere 
in  M,d.  The  total  frame  potential  is 

N  N 

TFP({Xi}?=1)  =  K*m,*n)|2. 

m= 1  n=  1 

The  equilibrium  points  of  the  frame  force  on  S d~1  produce  all  finite  unit 
norrned  tight  frames  in  the  following  way. 

Theorem  2.2.  Let  N  <  d.  The  minimum  value  of  the  total  frame  potential, 
for  the  frame  force  (2-4)  and,  N  variables,  is  N;  and  the  minimizers  are 
precisely  all  of  the  orthonormal  sets  of  N  elements  in  M,d. 

Theorem  2.3.  Let  N  >  d.  The  minimum  value  of  the  total  frame  potential, 
for  the  frame  force  (2-4)  and  N  variables,  is  N2/d;  and  the  minimizers  are 
precisely  all  of  the  finite  unit  norrned  tight  frames  of  N  elements  for  Md. 

3.  A  CLASSICAL  MECHANICAL  INTERPRETATION  OF  THE  FRAME 
OPTIMIZATION  PROBLEM 

In  this  section  we  shall  use  the  concept  of  frame  force  defined  by  (2.4)  to 
give  the  frame  optimization  problem  an  interpretation  in  terms  of  classical 
mechanics,  even  though  it  is  essentially  equivalent  to  a  quantum  detection 
problem  from  quantum  mechanics.  To  this  end  we  first  reformulate  Problem 
1.2  in  terms  of  orthonormal  bases  instead  of  1-tight  frames.  This  can  be  done 
by  means  of  Naimark’s  theorem  [19,  27].  In  fact,  each  tight  frame  can  be 
considered  as  a  projection  of  an  equal  norrned  orthogonal  basis,  where  the 
orthogonal  basis  exists  in  a  larger  ambient  Hilbert  space.  The  following  is 
a  precise  statement  of  Naimark’s  theorem,  see  [16],  and  see  [19,  48]  for  full 
generality. 

Theorem  3.1.  (Naimark)  Let  H  be  a  d-dimensional  Hilbert  space  and 
let  {ei}^L1  be  an  A-tight  frame  for  H .  There  exists  an  orthogonal  basis 
C  H'  for  H' ,  where  H'  is  an  N -dimensional  Hilbert  space  such  that 
H  is  a  linear  subspace  of  H' ,  where  each  ||ej||  =  A,  and  for  which 

\/i  =  1, ... , IV,  =  e*, 

where  Ph  is  the  orthogonal  projection  of  H'  onto  H. 
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We  now  prove  the  converse  of  Naimark’s  theorem,  that  is,  we  prove  the 
assertion  that  the  projection  of  an  orthonormal  basis  gives  rise  to  a  1-tight 
frame. 

Proposition  3.2.  Let  H'  be  an  N -dimensional  Hilbert  space  and  let 
be  an  orthonormal  basis  for  H' .  For  any  linear  subspace  U  C  H' , 
is  a  1 -tight  frame  for  U ,  where  Pp  denotes  the  orthogonal  projection  of  H' 
onto  U. 

Proof.  For  any  x  G  U,  note  that  P\jx  =  x.  Since  {e'}^=1  is  an  orthonormal 
basis  for  H'  we  can  write 

N  N  N 

IMi2  =  5^l(eJ,®)  I2  =  ]T|  (e'i,Pux)\2  =  ^2\(Pue'i,x)\2. 

2=1  2=  1  2=1 

Since  this  is  true  for  all  x  G  U,  it  follows  that  {Pue'ijiLi  is  a  1-tight  frame 
for  U.  □ 

Theorem  3.3.  Let  H  be  a  d-dimensional  Hilbert  space,  and  let  {xi}fL1  C  H 
be  a  sequence  of  unit  normed  vectors  with  a  sequence  {pi}P=1  C  M  of  positive 
weights  that  sums  to  1.  Let  H'  be  an  N- dimensional  Hilbert  space  such  that 
H  is  a  linear  subspace  of  H' ,  and  let  (ej}^1  be  a  1-tight  frame  for  H  that 
minimizes  Pe  over  all  N  element  1-tight  frames  for  H,  i.e., 

Pe({ei}?=l)  =  inf  {Pe{{yi}f=  i)  :  {yi}f=\  a  1-tight  frame  for  H)  . 

(A  minimizer  exists  by  Theorem  A. 7.)  Assume  {e^}^  is  an  orthonormal 
basis  for  H'  that  minimizes  Pe  over  all  orthonormal  bases  for  H' ,  i.e., 

Pe({ei}iLi)  =  inf  {Pe({Ui}iLi)  ■  {yi}iLi  in  orthonormal  basis  in  H'}  . 

Then 

Pe({ei}ti)  =  Pe^ti)  =  PedPHe^h), 

where  Ph  is  the  orthogonal  projection  onto  H . 

Proof.  Since  each  xt  G  H,  note  that  PhXz  =  xp,  and  so,  using  the  fact  that 
Ph  is  self-adjoint,  we  have 

N  N 

Pe({e'i}f=  i)  =  1 -^Pi|(a:i,e')|2  =  1 -^pi|(PH®i,e')|2 

2=1  2=1 

N 

=  1  |2  =  PedPHettiLl). 

2=1 

It  remains  to  show  that  Pe{{e,}]'Ll)  =  Pe({e^}^1).  By  Proposition  3.2, 
{PHc'ilfLi  is  a  1-tight  frame  for  H.  Thus,  by  the  definition  of  the  set 
{ej}^  C  H,  it  follows  that 

Pe({e[}l i)  =  PedPWjill)  >  Pe{{ei}f=1). 
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Now,  by  Naimark’s  theorem,  there  exists  an  orthonormal  basis  {yi}^=  \  C 
H'  such  that 

{Phv,}^  =  {<*}£,. 

Hence,  we  have 

N  N 

Pe{{ei}tl)  =  1  -  ^Pi\{xi,Zi)\2  =  1  -  ^2  Pi\(Xi,  PHyi)\2 

i=  1  i=l 

N  N 

=  1  ~^2pi\(PHXi,yi)\2  =  1  ~^2pi\{xi,yi)  |2 

i=  1  i= 1 

=  PMVi] ill)  >  P,({e !}£,), 

where  the  last  inequality  follows  from  the  definition  of  the  set  {e^}^  C  H' . 
The  result  follows.  □ 

We  conclude  that  finding  an  N  element  1-tight  frame  {e,}^=1  for  H  that 
minimizes  Pe  over  all  N  element  1-tight  frames  is  equivalent  to  finding  an 
orthonormal  basis  {e^}^  for  H'  that  minimizes  Pe  over  all  orthonormal 
bases  for  H' .  Once  we  find  {e'i}^=1  C  H'  that  minimizes  Pe,  we  project  back 
onto  H ,  and  {PH&i}iLi  is  a  1-tight  frame  for  PI  that  minimizes  Pe  over  all 
N  element  1-tight  frames. 

Consequently,  the  frame  optimization  problem  can  be  stated  in  the  fol¬ 
lowing  way. 

Problem  3.4.  Let  H  be  a  d-dimensional  Hilbert  space,  and  let  {xi\^L  1  C  H 
be  a  sequence  of  unit  norm  vectors  with  a  sequence  {pi}f=i  C  M  of  positive 
weights  that  sums  to  1.  Assume  N  >  d.  Let  H 1  be  an  IV-dimensional 
Hilbert  space  such  that  H  is  a  linear  subspace  of  H' .  The  frame  optimization 
problem  is  to  find  an  orthonormal  basis  {e^},^1  C  H'  that  minimizes  Pe  over 
all  N  element  orthonormal  sets  in  H' . 

Using  the  definition  of  the  frame  force  in  Section  2.3,  the  frame  optimiza¬ 
tion  problem  can  now  be  given  a  classical  mechanical  interpretation  in  the 
case  where  H  =  Md.  This  interpretation  motivates  our  approach  in  Section 
4.  Let  H  C  H'  =  WN .  We  want  to  find  an  orthonormal  basis  {e'i}fL1  C  H ’ 
that  minimizes  Pe  over  all  orthonormal  bases  in  H' .  We  consider  the  quan¬ 
tity  Pe  as  a  potential 

N  N 

V  =  Pe  =  ^pi(l-\(xi,e'i)\2)  =  J2Vi, 

i—  1  i= 1 

where  each 

Vi  =  pi(  1  -  (xj,e')2)  =  pi  ^1  “  (l  “  \\\Xi  ~  eiH2)  ’ 

and  where  we  have  used  the  fact  that  ||x,;||  =  |e^||  =  1  as  well  as  the  relation 
| \xi  -  e'||2  =  (xi  -  e[,Xi  -  e'}  =  ||a:,;||2  -  2(xi,e'i)  +  ||e'||2  =  2  -  2{xi,eli). 
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Since  each  Vi  is  a  function  of  the  distance  \\xi  —  e[\\,  Vi  corresponds  to 
a  conservative  central  force  between  the  points  x%  and  e[  given  by  Fi  = 
— VjVi,  where  V*  is  an  ^-dimensional  gradient  taken  by  keeping  Xi  fixed 
and  differentiating  with  respect  to  the  variable  e[.  Setting  x  =  \\xi  —  e'||,  we 
can  write 


Vi(\\Xi 


ei\\)  =  Pi 


Taking  the  derivative  with  respect  to  x  gives 

v'i(x)  =  -2 pi  ^1  -  ^x2^  (- x )  =  2 pi  ^1  -  ^ x 2^j  x  =  -xfi(x), 


so  that 


fi{x)  =  —2 pi  (  1  -  -x2 


Therefore,  the  corresponding  central  force  can  be  written  as 

Fiix^e'i)  =  fiiWxi-e'ilDixi-e'j)  =  -2 p.t  ^1  -  ^||xi-e'|j2^  (x—e-)  =  -2 pi(xi,e'i}(xi-e'i). 


Fi  is  frame  force! 

Thus,  the  setup  for  the  frame  optimization  problem  can  be  viewed  as  a 
physical  system,  where  the  given  vectors  are  fixed  points  on  the  unit 

sphere  in  H' ;  and  we  have  a  ”  rigid”  orthonormal  basis  which  moves 

according  to  the  frame  force  Fi  between  each  e[  and  x^.  The  problem  is  to 
find  the  equilibrium  set  {e'i\™=l.  These  are  the  points  where  all  the  forces 
Fi  balance  and  produce  no  net  motion.  In  this  situation,  the  potential  V 
obtains  an  extreme  value,  and,  in  particular,  we  shall  consider  the  case  in 
which  V  is  minimized. 


4.  Solution  of  frame  optimization  problem 

4.1.  Differential  equations  on  O(N).  Using  Newton’s  equation  and  the 
orthogonal  group  O(N),  we  produce  a  system  of  differential  equations  asso¬ 
ciated  with  the  setup  of  Section  3. 

Let  {bi}^L1  be  a  fixed  orthonormal  basis  for  H' .  Since  0(N )  is  a  smooth 
compact  N(N  —  1)  / 2- dimensional  manifold  [52],  there  exists  a  finite  number 
of  open  sets  Uk,  k  =  1 , . . . ,  M,  in  R^U-1)/2  and  smooth  mappings  0*,  : 

Uk  — i ►  O(N),  k  =  1, . . . ,  M,  such  that 

M 

U  &k{Uk)  =  O(N). 

k=  1 

Since  any  two  orthonormal  bases  are  related  by  an  orthogonal  transfor¬ 
mation,  then,  for  each  k  =  1, . . . ,  M ,  we  can  smoothly  parameterize  the  or- 
thonormal  basis  {6*}^1  in  terms  of  N(N—  1) /2  real  variables  (qi, . . . ,  qN(N -i)/2)  £ 
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Uk  by  the  rule 


{e'i(qi,  .  .  .  ,  (?jV(IV— l)/2)}j=l  —  {®k(qi,  ■  ■  ■  ,  QN(N-l)/2)bi}i=i, 

which  defines  a  family  of  orthonormal  bases  for  H' .  As  k  goes  from  1 

to  M,  we  obtain  all  possible  orthonormal  bases  in  H' .  We  now  use  Newton’s 
equation  to  convert  the  frame  forces  Fi,  i  =  1 , ,N,  acting  on  an  orthonor¬ 
mal  basis  {e^}^=1  for  H'  into  a  set  of  differential  equations  that  determines 
the  dynamics  of  coordinate  functions  q(t)  =  . . . ,  qN(N-i)/2(t))  £ 

[C'2(]R)]7V(7V— 1)/2. 

We  treat  Pe  as  a  potential  and  use  Newton’s  equation  to  obtain 

(  if(«(*))  \ 


m  =  -w  =  -VPe(q(t)) 


where  V  =  Pe.  Note  that 


dPe 


\  9qN(N- 1)/2 


(?(*)) 


dV 

dqj 


O  N 

~EV‘ 


N 


EVF 


i= 1 
N 


(K 

dqj 


N 


de': 


2  ^Pi(xj,e')(e' 


1=1 


2  'Y^pi(xi,e'i) 


i= 1 


% 


A 


2^2pi(xi,e'i) 


i= 1 


dqj 


Using  the  fact  that  (e^e')  =  1  and  taking  the  derivative  of  this  expression 
with  respect  to  qj  give 


Consequently, 


and  we  have 


d  ,  A  /  ,  _d_  ,  \  _  n 

<%e*’ey  +  \  <%e*  °‘ 


^  e',e')  0, 


3U 

% 


JL  /  DA  \ 


Therefore,  Newton’s  equation  of  motion  becomes  the  IV  (IV  —  l)/2  equa¬ 
tions, 


N  / 

=  -2  ^Pi(xj,e')  /  a;*, 

i=l  ' 


dQj 


j  =  1, . . . ,  A (JV  —  l)/2.  (4.1) 
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RN(N-l)/2 


Figure  2.  Relation  between  the  orthogonal  group  and  the 
solutions  of  Newton’s  equation  of  motion.  Wi  is  defined  for 
all  6  e  O(N)  by  Wi{6)  =  Obi  e  RN . 


By  Theorem  2.1,  if  (qi(t), . . .  ,qNrN_iy2(t))  is  a  solution  to  (4.1),  then 
the  energy , 

x  N(N-l)/2 

E{t)  =  -  Y  l%(i)|2  +  Pe(qi(t), . . .  ,qN(N-l)/2(t)), 
i= 1 

is  a  constant  in  time  t. 

We  summarize  the  relationship  between  the  parameterized  orthogonal 
group  and  the  solutions  of  Newton’s  equation  in  Figure  2.  The  analytic 
assertions  of  this  relationship  are  the  content  of  Theorems  4.1  and  4.2. 

Theorem  4.1.  Let  H  be  a  d-dimensional  Hilbert  space,  and  let  {xi}ff1  C  H 
be  a  sequence  of  unit  norm  vectors  with  a  sequence  {pi}^  C  M  of  positive 
weights  that  sums  to  1.  Assume  {e'i}^L1  is  an  orthonormal  basis  that  mini¬ 
mizes  Pe.  Let  Qk{qi i  ■  ■  ■ ,  qN(N-i)/2)  ^  O(N)  have  the  property  that 

\Ji  =  1, . . . ,  N,  . . . ,  <?AT(Ar_i)/2)  =  e'i. 

Then  the  constant  function, 


{qi(t), . . . ,  qN{N-i)/2(t))  —  (<7i>  •  •  •  >  Qn(N-i)/2),  (4-2) 

is  a  solution  of  Newton’s  equation  of  motion  in  O(N)  that  minimizes  the 
energy  E,  and 


Vj  =  1,  •  ■  •  ,N(N—l)/2, 


N 

Yj  1)  ■  '  •  )  qN(N- 1)/2)) 

i=  1 


dqj 


(<7i>  ■  •  •  i  <7jv(jv-i)/2) 


(4.3) 


Proof.  First,  since  {e(}(^=1  minimizes  Pe  at  the  point  (qi, . . . ,  p)v(jV-i)/2)>  we 
must  have 

-r^{qi,...,qN{N-i)/2)  =  0- 
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Since 

dPe  .  />  /  de[  \ 

we  have  (4.3). 

Second,  we  show  that  (4.2)  is  a  solution  of  Newton’s  equation.  Because 
( qi(t ), . . . ,  qN(N-i)/2(t))  is  constant  with  respect  to  t,  we  have 

8Pe 

Qi(t)  =  0  =  —  . . . ,  gjv(iv-i)/2)) 

=  -2  ^  Pi(arj,  e-(gi(i), . . . ,  gjv(iv-i)/2(i)))  (  %i,  (*),  •  •  • ,  QN(N-i)/2(t)) 

i= 1  \ 

Therefore,  (f/i(t), . . . ,  9at(iv-i)/2(0)  is  a  solution  of  Newton’s  equation. 

Finally,  for  each  i  =  1, . . .  ,N(N  —  l)/2,  we  have  i/,(f)  =  0,  and  so  the 
energy  A  satisfies 

E  =  Pe. 

Since  e[(qi, . . . ,  ?jv(iv-i)/2)  minimizes  Pe,  it  follows  that  the  energy  is  mini¬ 
mized.  □ 

The  following  theorem  relates  the  solutions  of  Newton’s  equation  with  the 
frame  optimization  problem. 

Theorem  4.2.  Given  the  hypotheses  of  Theorem  f.l.  Let  (qi(t), . . . ,  ?at(at-1)/2(^)) 
be  a  solution  of  Newton’s  equation  of  motion  that  minimizes  the  energy  E. 

Then  (qi(t), . . .  ,qN(N-i)/2(t))  a  constant  solution,  i.e., 

Vi  =  1, . . .  ,N(N  —  l)/2,  d^{t)  =  0, 

and 

{PHe'i{qi{t), qN(N-i)/2(t))}iLi  £  H 
is  a  1-tight  frame  for  H  that  minimizes  Pe. 

Proof.  Suppose  (qi(t), . . . ,  qj\r(N- 1)/2(^))  is  a  solution  of  Newton’s  equations 
of  motion  that  minimizes  the  energy  E.  Assume  that  (qi(t), . . . ,  </at(jv-i)/2(£)) 
is  not  a  constant  solution.  Denote  by  (qi, . . . ,  </at(jv-i)/2)  a  point  from  The¬ 
orem  4.1  such  that 

Wi(qi,  •  •  •  ,  QN(N-l)/2)}iLl 

is  an  orthonormal  basis  that  minimizes  Pe.  Since  (qi(t), . . . ,  qN(N-i)/2{t))  is 
not  a  constant  solution,  there  exists  a  to  £  K-  such  that  the  kinetic  energy 

N(N—l)/2 

t=7  Y. 

i= 1 

and,  by  Theorem  2.1,  the  energy  is  constant.  Thus,  for  all  t,  we  have 
E{qi{t),  ,  qN(N-l)/2(t ))  =  T(qi{to),  .  .  .  ,  <Zjv(IV-1)/2(*o))  +  -Fe(<?i(io)>  •  •  •  >  <7lV(lV-i)/2(£o)) 

>  Pe(qi,  ■  ■  ■  ,  Qn(N-1)/2)  =  E(qi,  .  .  .  ,  <7jV(JV-l)/2)> 
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which  contradicts  the  assumption  that  (qi(t), . . . ,  qN(N-i)/2{t))  is  a  solu¬ 
tion  that  minimizes  the  energy  E.  It  follows  that  . . .  ,qNrN-i)/2(t)) 

must  be  a  constant  solution.  Hence,  T  =  0,  and  so  (qi(t), . . . ,  qN(N-i)/2{t)) 
minimizes  E  =  Pe.  By  Theorem  3.3  it  follows  that 

{PHe'i(qi(t), ...,  qN(N-i)/2(t))}f=i  Q  H 
is  a  1-tight  frame  for  El  that  minimizes  Pe.  □ 


4.2.  Parameterization  on  SO(N).  Let  be  a  fixed  orthonormal 

basis  for  H' .  We  can  locally  parameterize  the  elements  in  0(N )  by  N(N  — 
l)/2  variables  so  that  9(qi, . . . ,  qN(N-i)/2)  £  O(N).  We  obtain  a  smooth 
parameterization  of  {bi}f=1  by  setting 

Vi  =  l,...,iV,  e'^qi, . . .  ,qN(N-i)/2)  =  9(qi,  ■  ■  ■  ,qN(N-i)/2)bi-  (4.4) 

O(N)  has  two  connected  components,  SO(N)  and  G(N)  =  0(N)\S0(N). 
The  parameterization  (4.4)  depends  on  the  choice  of  which  component, 
SO(N)  or  G(N),  we  find  or  choose  6(qi,  ■ . . ,  9jv(jv-i)/2)-  We  shall  show 
that  a  global  minimizer  of  Pe  occurs  in  both  components,  so  it  suffices  to 
parameterize  the  orthonormal  basis  using  only  SO{N).  We  do  this  by  con¬ 
structing  a  bijection  g  :  SO(N )  — »  G(N),  and  use  this  bijection  to  show 
that  minimizers  in  SO(N)  correspond  to  minimizers  in  G(N). 


Lemma  4.3.  Let  {bi}fL1  be  a  fixed  orthonormal  basis  for  an  N -dimensional 
Hilbert  space  H' ,  and  let  f  \  H'  —>  H'  denote  the  linear  transformation 
defined  by 


- k , 

9ii 


if  i  =  1 
if  N  >i>  1 . 


m  = 

Define  the  function  g  :  SO{N)  — >  G(N)  by 

\/6  €  SO(N),  g(6)  =  6-£ 


Then  g  is  a  bijection. 


Proof.  For  all  9  €  SO(N),  it  is  clear  that  g(9)  €  G(N)  since 

det(0)  =  1  =>■  det(g(0))  =  det(0  •  ^)  =  det(0)  •  det(^)  =  —  1  =$■  g{9)  G  G(N). 

With  respect  to  the  basis  {6*}(Y=1,  we  can  write  £  as 

'-10 
0  1 


£  = 


1 


Thus,  f  is  invertible,  and  hence  injective.  The  surjectivity  is  elementary  to 
check,  and  so  g  is  a  bijection.  □ 
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Theorem  4.4.  Let  {6j}^1  be  a  fixed  orthonormal  basis  for  the  real  N- 
dimensional  Hilbert  space  H' ,  and  let  {xi\f=1  C  H'  be  a  sequence  of  unit 
normed  vectors  with  a  sequence  {pi\f=1  C  M  of  positive  weights  that  sums  to 
1.  Consider  the  error  function  Pe  :  O(N)  — >  M  defined  by 

N 

ye  €  o{n),  p(e)  =  i-^Pi\(xi,6bi)\2. 

i= 1 

Since  SO(N)  is  compact  and  P  is  continuous  on  O(N),  there  exists  6'  G 
SO(N)  such  that 

ye  e  so(n),  p{e')  <  p{e). 

Similarly,  since  G(N)  is  compact,  there  exists  9"  G  G(N)  such  that 

ye  €  g(n),  P{e ")  <  p(0). 

Then, 

P(8')  =  P{9"). 

Proof.  First,  note  that,  for  any  9  G  SO(N), 

N 

p{g{9))  =  i  ~^2pi\{xi,g(d)bi)\2 

i= 1 
N 

=  1  ~^2pi\(xi,8  ■  fbi)\2 

i= 1 

N 

=  l-pi\{xi,8(-bi))\2  -^2pi\(xi,9bi)\2 

i= 2 
N 

=  1  -  Pl\{xi,  0(6i))|2  -J^PiKxi’  I2 

i=2 

=  P(0). 

We  complete  the  proof  by  contradiction.  Suppose  that  P(9')  P(9").  Con¬ 

sider  the  case  that  P{9")  >  P{9').  Then  g{9')  G  G(N)  has  the  property  that 
P(9")  >  P{9')  =  P(g(0'))  which  contradicts  the  definition  of  9"  G  G(N).  A 
similar  argument  works  for  the  case  with  P{9")  <  P(9')  by  considering  the 
function  g~l  :  G(N)  — >  SO(N).  □ 

By  the  above  theorem,  it  suffices  to  do  the  parameterization  in  our  anal¬ 
ysis  over  SO(N). 

4.3.  Friction.  Since  our  force  is  conservative,  the  energy  Eft)  for  the  so¬ 
lutions  of  Newton’s  equation  is  a  constant  function.  If  these  solutions  are 
not  minimum  energy  solutions,  it  is  possible  that  if  we  add  a  friction  term 
to  the  original  equations,  then  the  new  set  of  solutions  may  converge  to  a 
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minimum  energy  solution.  These  modified  equations  of  motion  with  friction 
are 

8P 

Vj  =  1,  •  •  • ,  -/V (N  —  l)/2,  qj  +  -^  =  -qj.  (4.5) 

Theorem  4.5.  Assume  that  . . . ,  qN(N-i)/2(t))  a  solution  to  the 

modified  equations  of  motion  (4-5).  The  energy  E  satisfies 


N{N- 1)/2 

jtE^)  =  -  E  ®(*)2- 

1=1 


(4.6) 


Proof.  Multiplying  the  modified  equations  of  motion  (4.5)  by  qj  and  sum¬ 
ming  over  j  give 

N{N- 1)/2  r  N(N- 1)/2 


E 

3= 1 


qj  + 


OP 

Oqj 


Qj  = 


E 

3= 1 


^T 


JV(JV-l)/2 

dt  2  E  fel2. 

i= 1 


The  first  term  on  the  left  side  is 
N(N—l)/2 

E  '0‘ii 

3= 1 

and  the  second  term  on  the  left  side  is 

lV(iV— 1)/2 

E 

3=1 

Therefore,  we  have 

,  j  / 1  ^(^-b/2 

=  E  fe(*)]2 +  %(*)) 


op(:  .  dp 


dt 


3=1 


N(N—l)/2 

E  &(*)s 

jf=i 


and  this  is  (4.6). 


□ 


4.4.  Numerical  considerations.  Recall  that  Theorem  4.1  states  that  the 
minimum  energy  solutions  satisfy 

N  /B  \ 

Y^Pi{xi,efiq(t)))  (xu  7^(g(t))y  =  0.  (4.7) 

This  opens  the  problem  to  numerical  approximations.  For  example  a  multi¬ 
dimensional  Newton  iteration  can  be  used  to  approximate  these  (gi, . . . ,  qN(N-i)/2) 
that  satisfy  (4.7).  Furthermore,  the  error  Pe  can  now  be  considered  as  a 
smooth  function  of  the  variables  q  =  (gi, . . .  ,qN(N-i)/2),  he., 

N 

Pe(q)  =  1  -^2pi\(xi,ei(q))\2. 

2—1 


(4.8) 
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As  such,  other  numerical  methods  become  available.  For  example,  the  con¬ 
jugate  gradient  method  can  be  used  to  approximate  a  1-tight  frame  that 
minimizes  Pe  as  written  in  (4.8). 

The  modified  equations  with  friction,  viz.,  (4.5),  give  a  method  of  com¬ 
puting  a  tight  frame  with  minimum  detection  error.  Let  {e(}^1  be  any 
orthonormal  basis  for  H' ,  the  extended  IV-dimensional  Hilbert  space  of  the 
d-dimensional  space  H ,  and  let  0(<?i, . . .  ,qN(N-i)/2)  be  a  local  parameter¬ 
ization  of  SO(N).  Assume  q(t)  is  a  solution  of  the  modified  equations  of 
motion  with  friction,  viz.,  (4.5),  with  initial  conditions 

9(0)  =  4(0)  =  1. 

By  Theorem  4.5,  for  all  t  >  1  where  the  solution  is  defined,  we  obtain  that 

{Paewt))®, 


is  a  1-tight  frame  with  a  decreasing  energy  as  t  increases.  In  fact,  it  can  be 
shown  that  these  initial  conditions  of  the  differential  equation  (4.5)  guaran¬ 
tee  that  the  solutions  approach  a  global  minimum  energy  solution  of  (4.1), 
see  [43]  for  a  proof.  To  illustrate,  suppose  we  are  given  the  set  of  three 
vectors, 


'  1  ' 

'  0  ' 

Xl  = 

0 

,  X2  = 

1 

l 

± 

V2 


with  equal  weights  pi  =  1/3,  as  shown  in  Figure  3. 

Using  a  method  of  parameterizing  SO(N),  as  expounded  in  [43],  we  solve 
(4.5)  with  initial  conditions  q( 0)  =  4(0)  =  1.  The  trajectories  are  illustrated 
in  Figure  4. 

This  corresponds  to  the  1-tight  frame  for  H  =  M2  that  minimizes  the 
detection  error,  shown  in  Figure  5. 

It  should  be  pointed  out  that  numerous  numerical  methods  have  been  de¬ 
veloped  to  construct  solutions  for  the  quantum  detection  problem,  mainly 
due  to  Eldar.  In  2001,  an  iterative  method  was  developed  for  finding  an 
orthonormal  basis  that  minimizes  Pe  for  the  uniform  weight  case,  see  [21]. 
It  was  shown  that  each  iterate  had  a  successively  smaller  value  for  Pe,  and 
that  the  iterates  converged,  however  they  are  not  guaranteed  to  approach  a 
global  minimum  Pe  solution.  In  2003,  a  semidefinite  programming  technique 
was  developed  that  computes  solutions  to  a  modified  quantum  detection 
problem.  The  algorithm  finds  the  optimal  measurement  while  minimizing 
the  probability  of  an  inconclusive  result,  see  [23].  This  approach  was  also 
applied  to  the  more  general  case  in  which  the  states  of  the  quantum  sys¬ 
tem  correspond  to  density  matrices  and  the  probability  of  an  inconclusive 
measurement  was  a  predefined  constant.  Specifically,  given  0  <  (3  <  1,  the 
goal  was  to  find  the  optimal  measurement  subject  to  the  constraint  that  the 
probability  of  an  inconclusive  result  is  given  by  /?,  see  [22],  Using  semidefi¬ 
nite  programming,  an  approximate  solution  to  the  problem  can  be  obtained 
with  arbitrary  accuracy.  By  adding  the  constraint  that  the  probability  of 
an  inconclusive  detection  equals  zero,  (3  =  0,  these  methods  can  be  used 
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Figure  3.  A  set  of  three  nonorthogonal  vectors  {a:j}?=1  with 
equal  weights  pi  =  1/3. 

to  obtain  approximate  solutions  to  the  original  quantum  detection  problem, 
[22,  28]. 

Our  method,  using  concepts  inspired  by  geometry  and  classical  physics, 
can  be  viewed  as  a  general  method  of  approximating  solutions  to  tight  frame 
optimization  problems.  As  proof  of  concept,  we  focused  on  an  alternative 
approach  to  finding  solutions  to  the  quantum  detection  problem.  The  imple¬ 
mentation  of  our  method  is  simple,  given  the  readily  available  mathematical 
software  packages  with  ordinary  differential  equation  solvers.  In  our  example 
above,  we  implemented  our  algorithm  in  MATLAB,  and  the  code  is  shown 
below. 

%  MATLAB  code  for  finding  the  optimal  tight  frame  of  N 
elements  using  an  ODE  solver 

N  =  3; 

x  =  [1  0  0;  0  1  0;  l/sqrt(2)  l/sqrt(2)  0]  %  Specifying  the 
quantum  states 
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Figure  4.  Solution  of  equation  (4.5)  with  initial  conditions 
9(0)  =  9(0)  =  1. 

rho  =  [1/3  1/3  1/3];  %  Specifying  the  weights 

%  ODE  solver 

qinitial  =  ones(l,  N*(N-1)); 

[t,  q]  =  ode45(@qmee,[0,  100],  qinitial); 
plot(t,  q); 

%  Finds  the  corresponding  frame  coordinates  for  e 

st  =  eye(N,  N); 

for  i  =  1:N  -  1; 

for  jj  =  i  +  1:  N; 

ortho  =  eye(N,  N); 

ortho(i,  i)  =  cos(y(length(t),  -(i*i)/2  +  N*i  -  i/2  -  N  +  jj)); 
orthofi,  jj)  =  -sin(y(length(t),  -(i*i)/2  +  N*i  -  i/2  -  N  +  jj)); 
ortho  (jj,  jj)  =  cos(y(length(t),  -(i*i)/2  +  N*i  -  i/2  -  N  +  jj)); 
ortho  (jj,  i)  =  sin(y(length(t),  -(i*i)/2  +  N*i  -  i/2  -  N  +  jj)); 
st  =  ortho*st; 
end 
end 
st 

The  function  qmee  includes  the  parameters  x  and  rho  in  its  definition, 
and  corresponds  to  the  term  —dPe/dqj  —  qj.  By  merely  substituting  with 
the  appropriate  potential  Pe ,  we  can  find  approximations  to  other  frame 
problems,  e.g.,  the  construction  of  equal-angular  tight  frames  or  finite  unit 
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Figure  5.  A  1- tight  frame  with  minimum  detection  error. 


norrned  tight  frames.  See  [43]  for  further  explanation  of  the  SO(N )  param¬ 
eterization,  coding,  rate  of  convergence,  and  other  applications.  There  has 
been  analogous  work  using  ideas  from  classical  mechanics  to  develop  numer¬ 
ical  methods  that  approximate  solutions  for  a  variety  of  other  mathematical 
problems,  e.g.,  see  [36,  37,  49,  38]. 


5.  Example  for  N  =  2 


Consider  the  case  where  we  are  given  {xi}f=1  C  H  =  M2  with  a  sequence 
{Pi)'i=\  °f  positive  weights  that  sum  to  1. 

We  want  to  find  an  orthonormal  system  {e(}?=1  that  minimizes  Pe.  SO{ 2) 
is  a  1-dinrensional  manifold.  A  parameterization  of  50(2)  can  be  given  for 
all  q  €  [0,  2-7t)  : 
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Let  {bi}2=1  be  the  standard  orthonormal  basis  for  H  =  M2.  We  construct 
the  parameterized  orthonormal  set  by  defining 

Now,  assume  q  is  a  function  of  time.  We  have 

-  i  ( 

and 

><*»  -  i  ( ^ )  -  -**»• 

Substituting  these  derivatives  of  e(  into  Newton’s  equation  of  motion  (4.1) 
give 

q{t)  =  2[p2{x2,e,2(q(t))){x2,e'1(q(t)))  -  pi(xi,  e/1(g(t)))(xi,  e2(q(t)))], 

which  is  a  second-order  ordinary  differential  equation. 

In  M2,  the  minimizer  can  be  explicitly  found.  To  this  end  and  to  simplify 
the  notation,  we  begin  by  writing 

e'i  =  e'i(q(t))  and  q  =  q(t). 


Next,  denote  the  given  vectors  by 


xi  = 


and  x2  = 


As  such,  we  obtain 
2 

y^(e',Xj)2  =  pi(acos(g)  +  6sin(g))2  +  p2(-csin(q)  +  dcos(q))2 

i=  1 


=  (pia2  +  p2d2)  cos 2(q)  +  2(piab  -  p2cd )  cos (q)  sin(g)  +  (p±b2  +  p2c 2)  sin2(g) 

=  ( pia 2  +  p2d2  -  p\b2  -  p2c2)  cos 2(q)  +  2(piab  -  p2cd)  cos (q)  sin (q)  +  (pib2  +  p2c2) 

=  acos2(q)  +  /3cos(q)  sin(q)  +  7, 


where 


a  =  (pia2  +  p2d2  -  pib2  -  p2c2) 

/3  =  2(piab  -  p2cd) 

7  =  {Pib2  +  P2C2). 

Hence,  we  have 
2 

^2  pi(e't,  Xi}2  =  cos(q)[acos(q)  +  f3sin(q)}  +  7 

i— 1 

=  \J a2  +  (32  cos (q)  [cos(£)  cos (q)  +  sin(£)  sin(g)]  +  7, 
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P 


where  £  £  [0,  27t)  has  the  property  that 

cos(f)  =  — 7  =  ,  sin(£)  =  , - 

v^T W 

Using  the  relation  cos(A)  cos(A+B)  =  2[cos(2A  +  U)-|-cos(-B)],  we  compute 


2 

^Piie'^Xi)2  =  y/  «2  +  P2  cos((7)[cos(£)  cos(g)  +  sin(£)  sin(qr)]  +  7 
i= 1 

=  \/a2  +  P2  cos (q)  [cos(<7  -  0]  +  7 

\  /  ofl  -j-  3 ^ 

=  V  2+/  [cos(2g-0  +  cos(0]+7- 

Therefore,  to  minimize  the  error  Pe,  we  want  to  maximize  pi(xi,e'i)2, 
and  this  occurs  exactly  when  q  =  £/2+7rn  for  some  integer  n.  Consequently, 
we  can  write  our  solution  as 

„  =  1 1,^"1  (  2{piab  ~  p2Cd) 

2  \{p\a2  +  p2d2  -  pib2 - 

for  some  n  G  N. 


Acknowledgment 

We  would  like  to  thank  Dr.  Stephen  Bullock  and  Professors  John  R. 
Klauder  and  Shrnuel  Nussinov  for  their  illuminating  comments.  This  work 
was  partially  funded  by  ONR  Grant  N000 1-402 1-0398  for  the  first  named 
author,  by  an  NSF-VIGRE  Grant  to  the  University  of  Maryland  for  the 
second  named  author,  and  by  NSF-DMS  Grant  0219233  for  both  authors. 


Appendix  A.  Appendix 

A.l.  Quantum  measurement  theory.  Quantum  theory  gives  the  prob¬ 
ability  that  a  measured  outcome  lies  in  a  specified  region  [40,  59,  11],  see 
Definition  A. 4.  These  probabilities  are  defined  in  terms  of  positive  operator¬ 
valued  measures. 


Definition  A.l.  Let  B  be  a  cr-algebra  of  sets  of  X,  and  let  H  be  a  separable 
Hilbert  space.  A  positive  operator-valued  measure  (POM)  is  a  function  n  : 
B  — >  C(H)  such  that: 

1.  V  U  G  B,  n(U)  is  a  positive  self-adjoint  operator  H  — >  H, 

2.  n(0)  =  0  (zero  operator), 


3. 


V  disjoint  {Ui}c^l  C  B,  x,y  G  H  =>• 


(Ui)x,y), 

i=  1 


4.  n(A)  =  I  (identity  operator). 
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Every  dynamical  quantity  in  quantum  mechanics,  e.g.,  the  energy  or  mo¬ 
mentum  of  a  particle,  corresponds  to  a  space  of  outcomes  X  and  a  POM 
n.  We  think  of  X  as  the  space  of  all  possible  values  the  dynamical  quantity 
can  attain.  X  could  be  countable  or  uncountable. 

Example  A. 2.  (1)  Suppose  we  wanted  to  measure  the  energy  of  a  hy¬ 

drogen  atom.  The  energy  levels  of  a  hydrogen  atom  are  discrete, 
and  X  consists  of  all  the  possible  discrete  energy  levels.  Hence,  X 
is  countable.  In  this  case,  H  =  L2(R3)  and  B  is  the  power  set  of  X. 

(2)  On  the  other  hand,  if  we  were  measuring  the  position  of  an  electron 
orbiting  its  nucleus,  then  X  is  the  space  of  all  possible  spatial  lo¬ 
cations  of  the  electron,  i.e. ,  X  =  M3  which  is  uncountable.  In  this 
case,  H  =  L2(M3)  and  B  is  the  Borel  algebra  of  M3. 

See  [35,  59]  for  discussions  of  the  notion  of  the  state  of  a  system  and  the 
model  of  physical  systems  in  terms  of  Hilbert  spaces. 

Definition  A. 3.  Given  a  separable  Hilbert  space  H ,  a  measurable  space 
(B,X),  and  a  POM  n.  If  the  state  of  the  system  is  given  by  x  £  H  with 
|| a; ||  =  1,  then  the  probability  that  the  measured  outcome  lies  in  a  region 
U  £  B  is  defined  by 

PU(U)  =  (x,U  (U)x). 

This  definition  can  be  viewed  as  that  of  a  POM  measurement ,  cf.,  [29]  for 
an  alternative  definition. 

Typically  in  quantum  mechanics,  measurements  are  modeled  using  res¬ 
olutions  of  the  identity  [53,  35,  24].  Using  POMs  in  the  theory  of  quan¬ 
tum  measurement  instead  of  traditional  resolutions  of  the  identity  has  some 
advantages.  For  example,  in  some  situations,  using  a  POM  measurement 
decreases  the  likelihood  of  making  a  measurement  error  [51].  Also,  the  foun¬ 
dation  of  quantum  encryption,  where  messages  cannot  be  intercepted  by  an 
eavesdropper,  is  based  on  the  theory  of  POM  measurements  [10].  Physical 
realizations  of  POM  measurements  can  be  found  in  [13,  12]. 

A. 2.  Quantum  mechanical  quantum  detection.  We  define  the  quan¬ 
tum  detection  problem  as  given  in  [27,  26]. 

Suppose  we  have  a  separable  Hilbert  space  H  corresponding  to  a  physical 
system,  but  that  we  cannot  determine  beforehand  the  state  of  the  physical 
system.  However,  suppose  we  do  know  that  the  state  of  the  system  must 
be  in  one  of  a  countable  set  Q  H  (where  K  C  Z)  of  possible  unit 

normed  states  with  corresponding  sequence  {pi}i^K  of  probabilities  that 
sum  to  1.  By  this  we  mean  that  pi  is  the  probability  that  the  system  is 
in  the  state  X{.  The  problem  is  to  determine  the  state  of  the  system,  and 
the  only  way  to  do  this  is  to  perform  a  measurement.  Consequently,  the 
problem  is  to  construct  a  POM  n  with  outcomes  X  =  K  with  the  property 
that  if  the  state  of  the  system  is  Xj  for  some  i  £  K,  then  the  measurement 
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asserts  that  the  system  is  in  the  zth  state  with  high  probability 

P(j)  =  (Xi,n(j)xi)  ~  {  l  i',1';  ,  •' 

If  the  state  of  the  system  is  Xi ,  then  (xt,  n(j)xi)  is  the  probability  that 
the  measuring  device  outputs  j.  Thus,  (xi,U(i)xi)  is  the  probability  of  a 
correct  measurement.  Since  each  Xj  occurs  with  probability  pj,  the  average 
probability  of  a  correct  measurement  is 

£  (correct)  =  £({{xi,U(i)xi)}i£K)  =  y  Pijxj,  U(i)xj). 

i£K 

Quite  naturally,  the  probability  of  a  detection  error ,  i.e.,  the  average  proba¬ 
bility  that  the  measurement  is  incorrect,  is  given  by 

Pe  =  1  -  ^2pi(Xi,U(i)Xi).  (Al) 

ieK 

Hence,  we  want  to  construct  a  POM  n  that  minimizes  Pe,  and  this  is  the 
quantum  mechanical  quantum  detection  problem  corresponding  to  Problems 
1.2  and  3.4. 

A. 3.  A  closer  look  at  the  quantum  detection  error.  We  shall  verify 
our  assertion  in  Section  A. 2  that  Pe,  defined  by  (A.l),  is  the  average  of 
the  probabilities  of  incorrect  measurements.  If  the  state  of  the  system  is  X{ 
for  some  i  €  K  and  if  i  /  j,  then  (xj,n(j)xj)  is  the  probability  that  we 
incorrectly  measure  the  system  to  be  Xj,  an  incorrect  measurement.  Thus, 
the  average  probability  of  an  incorrect  measurement  is  given  by 


£  (incorrect)  =  £{{{xi,H{j)xi)}i^j)  =  y  pj(xj,  U(j)xj). 

h O' 

We  want  to  show  that  Pe  =  £  (incorrect).  To  verify  this,  note  that 


Pi{Xi,  n (j)Xi)  +  ^2  Pi(Xi )  n (i)Xi) 
i^j  i£K 


Therefore, 


^2  Pi(Xi’U(j)Xi)  = 

i,j£K  i&K 

y,  Pi{xi,  ixi)  =  ypi= i- 

i£K  ieK 


Pe  =  1  ~  y  Pi(xi,U(i)xi)  =  y  Pi(xi,u(j)xi)  =  T (incorrect). 


ieK 


A. 4.  Using  tight  frames  to  construct  POMs.  The  theory  of  tight  frames 
can  be  used  to  construct  POMs.  Let  H  be  a  separable  Hilbert  space  and 
let  K  C  Z.  Assume  {ei}i^K  Q  H  is  a  1-tight  frame  for  H.  Define  a  family 
{n(rc)},(;cA'  of  self-adjoint  positive  operators  on  H  by  the  formula, 

Vx'  €  H.  n (w)x  =  '22(x,ei)ei. 

iG  w 
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It  is  clear  that  this  family  of  operators  satisfies  conditions  1-3  of  the  defini¬ 
tion  of  a  POM.  Since  {ei}i^K  is  a  1-tight  frame,  we  also  have 

Vx  £  H ,  U(K)x  =  ^2(x,ei)ei  =  x, 
ieK 

and  so  condition  4  is  satisfied,  where  X  =  K.  Thus,  II,  constructed  in  this 
manner,  is  a  POM. 


Remark  A. 4.  In  this  case,  the  detection  error  P,  becomes 

Pe  =  1  -  Pi(Xi,n(i)Xj) 

ieK 

=  1  -  ^2  Pi{xi,  (ei,  Xi)ei)  (A. 2) 

ieK 

=  1  -^2pi\(xi,ei)\2. 

ieK 

Thus  the  quantum  mechanical  quantum  detection  problem  reduces  to  finding 
a  1-tight  frame  that  minimizes  the  right  side  of  (A. 2);  and  this  right  side  is 
the  basic  error  term  (1.1)  of  the  frame  optimization  problem. 

The  following  result  is  a  converse  of  our  construction  of  a  POM  (for  the 
ex-algebra  of  all  subsets  of  Z)  for  a  given  1-tight  frame  for  H. 


Theorem  A. 5.  Let  H  be  a  d-dimensional  Hilbert  space.  Given  a  POM 
II  with  a  countable  set  X .  There  exists  a  subset  K  C  Z,  a  1-tight  frame 
{zi\ieK  for  H,  and  a  disjoint  partition  {Bi}i£x  Q  B  of  K  such  that 

Mi  £  X  and  Mx  E  H,  n(i)x  =  (x,  Cj)ej. 

i&Bi 


Proof.  For  each  i  £  X,  II(i)  is  self-adjoint  and  positive  by  definition  (noting 
positive  implies  self-adjoint  in  the  complex  case).  Thus,  by  the  spectral 
theorem,  for  each  i  £  X,  there  exists  an  orthonormal  set  {vj}jeBt  ^  H  and 
positive  numbers  {A j}jeBt  such  that 


Mx  £  H ,  H(i)x  =  A j(x,Vj)vj 

j&Bi 


j&Bi 


where 

Mj  £  Bi ,  ej  =  \f\jVj. 
Since  11(A)  =  I  we  have  that 


Vx  £  H,  x  =  Il(A)x  =  ^2  (x,ej)ej. 

jeUiBi 

It  follows  that  {cjjjeK  is  a  1-tight  frame  for  H. 


□ 


Consequently,  if  the  Hilbert  space  H  is  finite-dimensional,  analyzing  quan¬ 
tum  measurements  with  a  discrete  set  X  of  outcomes  reduces  to  analyzing 
tight  frames. 
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Keeping  in  mind  that  we  want  to  construct  and  compute  solutions  to  the 
frame  optimization  problem,  we  now  prove  that  solutions  do  in  fact  exist. 
The  proof  uses  a  compactness  argument.  We  start  with  a  lemma. 

Lemma  A. 6.  Assume  that  {e*}^  is  an  A-tight  frame  for  a  d-dimensional 
Hilbert  space  H .  Then, 

Vi  =  1, . . . ,  N,  ||  e*  ||  <  y/A. 


Proof.  Note  that  for  any  1  <  k  <  N  we  have 


Hence, 


and  so 


^Ikll2 


N 

5>fe,e;>|2 

i= 1 

IM4  +  £l<e^}|2. 

i^k 


||efc||4-A||efe||2  =  -^|<efe,e,)|2<0, 
i^k 


efc  1 1 2  —  A  <  0.  □ 


Theorem  A. 7.  Suppose  H  is  a  d-dimensional  Hilbert  space,  and  let  C 

H  be  a  sequence  of  vectors  with  a  sequence  {pi\^=l  C  M  of  positive  numbers 
that  sums  to  1.  There  exists  a  1 -tight  frame  {ej}^1  C  H  for  H  that  mini¬ 
mizes  the  error 

N 

Pe  =  1  —  'y  ^  Pi\ {xi,  ef)\  , 

1=1 

where  the  minimization  is  taken  over  all  1 -tight  frames  for  H  of  N  elements. 


Proof.  Let  F  be  the  set  of  all  N  element  1-tight  frames.  We  can  write  this 
set  as 

F=t{vi}g1CH:J2viv*=l\, 

where  v*  :  H  — ■>  K,  IK  =  M  or  K  =  C,  is  defined  by 

Vx  €  H,  v*x  =  (x,  v ). 

Also,  for  any  set  {ui}^=1  C  H .  define  the  norm, 

N 

ii{wi}iliii  =  ikii  H, 

2=1 

where  ||  •  ||  h  is  the  norm  on  H;  and  define  the  operator  norm  for  any  d  x  d 
matrix  M  as 

||M||  =  sup  ||Mu||jf. 

IMk=1 

(We  are  using  ||  •  \\h  to  distinguish  between  other  norms  in  this  proof.) 
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We  shall  first  verify  that  F  is  closed  in  H.  Suppose  we  have  a  sequence 
{{«? h=i}fcii  C  F  such  that 


linr  \\{u^}f=1  -  {iq}*=ill  =  0 

k — >oo 


for  some  set  {ui}^L1  C  H.  Then,  given  any  e  >  0,  there  exists  a  k  >  0 
such  that  ||{'U^'}^=1  —  {«i}^=1||  <  e.  To  show  E  F  we  begin  with  the 

estimate, 


N 


Y  UiUi  ~  1 


i= 1 


< 


< 


< 


N 


N 


+ 


N 


£ “?<«?)*  -  i 


i=  1  i=l 

N  N 

YUiUi  ~J2ui(ui 

i=  1  i= 1 

N 

^ Z(V’Ui)Ui  ~  (V’Ui)Ui 

i= 1 
N 

SUP  Y  \\{V,Ui)Ui  -  (v,Ui)Ui\ 

>\\h=1  j=i 
N 

sup  Y  (\\(V’Ui)Ui  -  iv,ui)ui\\H  +  \\(v,Ui)Ui  -  (v,Ui}Ui\\H) 
’llff=1  i= 1  V 


sup 

\\v\\h=1 


H 


H  H 


N 

=  sup  V  (\(v,u^)\\\u^ -Ui\\H  +  \{v,U^  -Ui)\\\Ui\\H) 

II, ,11  „  —  1  z '  \  / 


lhlU=i  i=i 


sup 

IMk=i 


{<}i=!  -  Wtill  nmx  ||«f  ||h  +  IIK}f=i  -  R}f=i 

l<i<Ar 


<  2e  max  \\uf  \\h  <  2e, 
l<i<N  "  1  "  “ 


where  in  the  last  inequality,  we  used  Lemma  A. 6  with  A  =  1.  Since  e  >  0  is 
arbitrary,  it  follows  that 


N 

Y  UiU*  =  /, 
i=l 

and  hence  {rq}^  E  F.  Thus,  F  is  closed. 

F  is  also  bounded  since,  given  any  {ui\f=1  E  F,  we  know  by  Lemma  A. 6 
that 

N 

IIKIilill  =  X]  INI#  ^  N- 

i=  1 


max 

l  <i<N 
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Let  {xj}^1  C  H  be  the  fixed  sequence  as  given  in  the  hypothesis,  and 
define  the  function  /  :  F  — >  M,  which  depends  on  {xi}f={,  by 

N 

e  F,  f{{ei}f=1)  =  1  I2- 

2= 1 

Given  any  {ui}^1:  {uj}^1  G  F.  we  have 

N  N 

2=1  2=1 

N 

<  ^2  Pi  \\{xi,Ui)\2  -  \(Xi,Vi)\2\ 

2  =  1 

N 

=  '22pi(\(xi,Ui)  \  -  \(Xi,Vi))(\(Xi,Ui)\  +  |(Xi,Uj}|) 

2=1 

N 

<  cy^j \{xj,Uj)  -  (xj,Vi)\ 

2=1 

N 

=  C^Kxum-Vi)] 

2=1 

N 

<  C^2\\xi\\H\\ui  -  Vi\\H 

2=1 

<  C  max  ||®i||tf||{«i}£=i  -  {vij-lill, 

1<2<AT 

where,  by  Lemma  A. 6, 

C  =  max  \\xi\\H{\\ui\\H  +  IKHtf)  <  2  max  ||xj||h. 

1<«<AT  l<j<Ar 

Therefore,  /  is  continuous  on  A.  Since  A  is  compact,  it  follows  that  there 
exists  {ei\F=1  £  F  that  minimizes  /.  □ 

A. 5.  MSE  criterion.  As  mentioned  earlier,  some  authors  have  solved  a 
frame  optimization  problem  using  the  MSE  error.  MSE  error  coincides  with 
the  quantum  detection  error  Pe  when  the  weights  are  all  equal  and  the  given 
vectors  have  an  additional  structure  known  as  geometrical  uniformity,  see 
[25,  58,  31]. 

Definition  A. 8.  Let  Q  =  {Ui}fL1  be  a  finite  Abelian  group  of  N  unitary 
linear  operators  on  a  Hilbert  space  H.  A  set  {xi}^L1  C  H  is  geometrically 
uniform  if  there  exists  an  x  G  H  such  that 


{xi}i=i  =  {Uix}f=1. 
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Definition  A. 9.  Let  H  be  a  separable  Hilbert  space,  let  K  C  Z,  and  let 
{xi}i<zK  be  a  frame  for  H.  The  associated  frame  operator  is  the  mapping 
S  :  H  — >  H  defined  by 

Vy  £  H,  S(y)  =  '£2(y,xi)xi. 

ieK 

Problem  A.  10.  Given  a  unit  norrned  set  {xi\™=1  —  E,  where  H  is  d- 
dimensional,  and  a  sequence  {pi\i=x  C  M  of  positive  weights  that  sums  to 
1.  The  weighted  MSE  problem  is  to  construct  a  1-tight  frame  {ei}^=l  that 
minimizes 

N 

E  =  -  ei ||2, 

2—1 

taken  over  all  A-element  1-tight  frames  for  H. 

An  analytic  solution  of  the  weighted  MSE  problem  can  be  constructed 
if  all  of  the  weights  are  equal  and  if  {xi}^L1  is  a  frame  for  H.  This  was 
independently  shown  by  Casazza  and  Kutyniok  [15],  and  Eldar  [21,  27,  29]. 
Further,  if  {xi\f=1  is  a  geometrically  uniform  frame  for  H,  Eldar  and  Forney 
[25,  26]  have  shown  that  this  is  also  a  solution  to  the  quantum  detection 
problem.  A  more  general  formulation  of  the  MSE  problem,  by  Srnale  and 
Zhou,  can  be  found  in  [54]. 

Theorem  A. 11.  Let  {xi}^=1  be  a  frame  for  H  with  frame  operator  S. 
{S~1^2Xi}^L1  is  the  unique  1-tight  frame  such  that 
N  (  N 

|| xi  —  S'^1/2Xj||2  =  inf  <  || Xi  —  e* 1 1 2  :  1-tight  frame  for  H 

i  I  l  i= 1 

and,  with  S  having  eigenvalues  {Aj}j=1,  we  have 
N  d 

ii Xi  -  s~i/2xi\\2  =  y^(A j  -  2^/x + 1). 

i=  1  j=l 

Further,  if  {xi}^=l  is  geometrically  uniform  then  {5_1/2Xi}^=1  minimizes 
the  detection  error  Pe  if  all  of  the  weights  are  equal,  and  {S~lt2Xi}I2Ll  is  a 
geometrically  uniform  set  under  the  same  Abelian  group  Q  associated  with 

Will- 

Remark  A. 12.  According  to  Theorem  A. 11,  {5_1/2Xi},^=1  is  the  unique  1- 
tight  frame  that  minimizes  the  MSE.  However,  it  is  not  the  unique  minimizer 
of  Pe.  For  example,  the  set  {(— 1  )-?<S'~1/2Xj}j][=1  is  also  a  minimizer  of  Pe. 
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